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The use of restrictive factor analysis (RFA) is 
illustrated with date, from the field of educational research. An 
attitude scale measuring the degree to which students feel they are 
accepted by their classmates is constructed in accordance with the 
Theory of Violators. The main idea of the Thecry of Violators is that 
most problems associated with measuring psychological constructs can 
be reduced to the question of unidiinensionality. The theory consists 
of three components: (1) a formal base of definitions of item purity 
and unidimensionelity that introduces the concept of violator, a 
variable with respect to which the test item is biased; (2) a 
typology of violators; and (3) instruction on how to construct a 
scale that is free of item bias, unidimensional, and efficient. As a 
first step, test items we~* selected from an existing measure, the 
School Attitudes Questionnaire of H. C. M. Voorst (1990) administered 
in the Netherlands to 915 students aged nine to 12 years, item bias 
detection was then performed through statistical analysis. After 
eliminating biased items, the remaining items were tested for 
unidiinensionality through factor analysis. Inefficient items were 
then detected through RFA. This exercise demonstrates that P" \ offers 
a single approach to various measurement problems. There is an 
eight-item list of references. (SLD) 
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Using Restricted Factor Analysis in Test Construction 

Frans J. Oort 
University of Amsterdam 

In psychology (and education) there are all sorts of 
attiLSf« SUrin 5 abili *! es ' aptitudes, personality traits, 
scale t hoi iTZt*' em ? tlons ' and so ™- To be valid, each test 
scale should be unidimensional and free of item bias, Using 

f«^o? mm0n i ° ^2°? el as an item res P°"se model, restrictive 
factor analysis (RFA) can be used to detect item bias, to test 
for unidimensionality, and to replace ordinary item analysis. 

data fro™ 6 ^ ^ a ?r^ th ! USS . ° f RFA is illustrated with some 
data from the field of educational research. attitude 

the^r*^- ?? thS dS ? r ! e t0 WhiGh sch ° o1 P u P- ls ^el that 
they are socially accepted by their classmates, will be 

1989?™99i?. ln accordance with the Theory of Violators (Oort, 

m-ohilU! f?fl! id6a ° f the Theory of Violators is that most 
problems that are associated with measuring psychological 

un?dimen^nn a ?'f e "^v* 0 ° ne probleS/The question of 

f 1 2SiSS;«. T he theory consists of three components, 
ine first component is a formal base made up by definitions of 

ordL P ?o 1 ?L and iV nidilnensionality - In thes * definition in 
order to lin?: all measurement problems, the concept of a 

potential violator is introduced. A violator is a variable 
co^nonfn? 6 ^ fc ° whi ? h a test item is biased. The second 
an ins?runJfn a typ ° lo 9 y of violators. The third component is 
a ?J; uct ion on how to construct a scale that is free of 
item bias, unidimensional and efficient. 

/Moll I1: f Parity is defined as a conditional independence 
(Mellenbergh, 1985, 1989): An item X is pure (unbiased? w J zh 
respect to potential violator V and given trait T if and only 

f ( x \ v = v, r=t) = g(X j r=t) (1) 

for all values v and t of the variables V and T, where 
function f is the distribution of the item responses given v 
and t, and function gr is the distribution of the item 
responses given t. Notice that the item purity definition 
does not depend on the measurement levels of variables X V 

difFA«r tral idea i n the Theory of Violators is that 

subXitSLf^^^r^P^ 131 ^ 8 ° nly differ in what is 
substituted for potential violator V. Five tvoes of no fpnf^i 

the 0l P r?ncipL e SftoffiW' ( J> ^ ^^^^^ 
reLrrtnS local . independence; (2) the Trait type, 

referring to the question of construct validity; m the 
Response Style type, referring to contaminating effects of 

Shirr eS i ! 4) the GrOU P ty * e < referring g to ' CtS ° f 
(in) stability of item parameters over groups (as in 
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S a Mn^?»i i i ^ m b i a « research) ; (5) the Time type, referring 
to (in) stability of item parameters over time. 

T * e ? eneral 9oal in test construction is to arrive at a 
test of minimum length that will yield scores with the 

ullVll'Z d r? re v of t r ?J- iabilit y validity for the intended 
fit dLV f roc ^r & Algina, 1986). Beginning with quite a 
thL tt^ln^ sel ? c ^ on / has t° ^ made. To accomplish that 

hXl SiT2* 10il ^ 16ldS (sub " ) scales that are free from item 
«nifimensional and efficient, three steps have to be 

™ (1 i cno °se and operationalize potential violators; (2) 
detect and remove biased items, and test for 

Seso 111 ^^-! 1 ^ (3) detSCt and remove ^efficient items. 
These steps will be pursued when they are applied to the 
construction of the 'social acceptance' (SA) scale 

taken T ?ro™ V L S ^ e ^ emS J° ! tart off witn ' SA items are simply 
OueSionn^o ?c^ ln f standard test ' the School Attitudes y 
m«!£}£ • (SAQ °? Vorst < 1990 >- The SAQ is a Dutch 
5E™«n r ? consistln g of "0 items with three-point 
motiv n t?nn C ?^ S roeasur i n \ childre "'s educational attitudes: 
and S?J " f °* scn ° o1 tasks, satisfaction with school life, 
There HZ ?« it enCe about .° ne ' s scholastic capabilities. 
There are 16 items measuring SA. This SA scale will be 

SScW to A beco ^. free of item bias, unidimensional and 
efficient. As mentioned above, the first step in test 
construction is to choose and operationalize potential 

I S; a i °' ? h f assert i°n of unidimensionality the choice 
of potential violators is crucial. In this case, potential 

Is ootent^ e ^ fro \ th * SA Q a * well. VarXbles operating 
SIiPSSS^ 1 vlolators of the Trait type are: Motivation and 
Self-confidence, both operationalized by adding 48 SAQ items 
Semf 001 ? 1 Desil f ab iiity, operationalized by adding ieSAQ ' 
Stv?e"tvoe a :n aY t ng " a P oten * ial violator of the Response 
a conf iS2*.?2f operationalized as the number of times that 
Two dfS^M. answer * s ^iven, irrespective of item content. 
violatS?s 2? lL V r riabl t S ' SSX and Age ' serve as Potential 
school nSn?L Lf ° U ? ^ The SAQ Was Ministered to 915 
school pupils 467 males and 448 females, aged nine to twelve. 

rtof-orJ? 6 . se( ? ond ste P m test construction, item bias 
SiTSi? 1 '*." don f through statistical analysis. Many item 
bias detection methods are available. The choice of? 
particular item bias detection method is dependent on the 

Here rfa JTSSSf °Z ^ ?* violators . 

ootentilt J? ft ?SE < BY accomm odating all items and all 
lal violators in one factor model, it is possible to 

in prlss) r ?S e f 2°^ ° f potential violators on Kerns (Sort, 
ZaJE ' ' * hree SA items appear to be severely biased one 
T^™ s re S 6Ct K t0 Y ea - Saying ' and two with respect to other si 
ihree'morH^^ 101 ^ 1 ^ the P rinc iPle of local independence, 
resoec? to a ? pea ? *° be moderately biased with 

respect to Social Desirability, Age, and Yea-savincr 
respectively. After the removal of all biased item4 fhp 
of remaining items should be unidimensional !by de?iAiUon) 
Using the common factor model as an item response model * ' 

s^srss.-* be tested for by fittin "- s&tor 
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The third step in test construction is to detect 
inefficient items. Thus far, the focus was on item bias, 
i.e., on items that measure something else besides what they 
are supposed to measure. Another possible flaw of test items 
is that they measure the trait of interest insufficiently. 
Remembering the general goal of test construction, an item 
should be efficient. An efficient item contributes to the 
reliability and validity of a scale. To detect inefficient 
items, a traditional item analysis can be done. 
Alternatively, one can make use of the information that one 
gets from fitting an item-response model. Again, the choice 
of model is partly determined by the measurement level of the 
test items. Here, the common factor model is used as an item 
response model and RFA is applied once more. Inefficient 
items can be detected by looking at the item reliability index 
or the information value. The item reliability index equals 
the quotient of common variance and total variance, and the 
item information value equals the quotient of common variance 

e* S *? Ual variance (Mellenbergh, 1991) . a rigid look at 
the SA items, reduced to ten already, yields two inefficient 
items . Removing them has only a small effect on the 
reliability of the SA scale as a whole. 

This exercise in using RFA to construct a scale in 
accordance with the Theory of Violators shows that there is 
more to item bias research than just bias in dichotomous items 
?i 2 £™ pe * to nominal violators. This exercise also shows 
that RFA offers a single approach to various measurement 
problems. And, what is more, by investigating item bias with 
respect to several potential violators at once, item bias 
often is better understood. 

However, RFA has its disadvantages too. Firstly rfa 
really cannot be applied to dichotomous items, though there 

SEMISf! r ° U 2 d th ! P roblem of fact °r analyzing non-continuous 
variables. Secondly, by using RFA, the notion of statistical 
independence in the item purity definition is relaxed to the 

k linear independence. Therefore, non-uniform bias 
cannot be investigated. 

uh M Zi~t* ly ' ^! re is . one caveat that has to be addressed. 
When working with RFA in the above way, one has to be careful 
not to over-emphasize unidimensionality at the cost of, for 
example, content validity. A test constructor has to 
compromise between unidimensionality, efficiency, reliability 
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